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Al will have significant, far-reaching economic and societal 
impacts. Technology shapes the lives of individuals, how we 
interact with one another, and how society as a whole evolves. We 
believe that decisions about how Al behaves should be shaped by 
diverse perspectives reflecting the public interest. 


Laws encode values and norms to regulate behavior. Beyond a 
legal framework, Al, much like society, needs more intricate and 
adaptive guidelines for its conduct. For example: under what 
conditions should Al systems condemn or criticize public figures, 
given different opinions across groups regarding those figures? 
How should disputed views be represented in Al outputs? Should 
Al by default reflect the persona of a median individual in the 
world, the user’s country, the user's demographic, or something 
entirely different? No single individual, company, or even country 
should dictate these decisions. 


AGI should benefit all of humanity and be shaped to be as 
inclusive as possible. We are launching this grant program to take 
a first step in this direction. We are seeking teams from across the 
world to develop proof-of-concepts for a democratic process that 


could answer questions about what rules Al systems should follow. 
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We want to learn from these experiments, and use them as the 
basis for a more global, and more ambitious process going 
forward. While these initial experiments are not (at least for now) 
intended to be binding for decisions, we hope that they explore 
decision relevant questions and build novel democratic tools that 
can more directly inform decisions in the future. 


The governance of the most powerful systems, as well as 


decisions regarding their deployment, must have strong public 
oversight. This grant represents a step to establish democratic 
processes for overseeing AGI and, ultimately, superintelligence. It 
will be provided by the OpenAl non-profit organization, and the 
results of the studies will be freely accessible. 


What do we mean by a “democratic process’? 


By “democratic process,” we mean a process in which a broadly 
representative group of people“ exchange opinions, engage in 
deliberative discussions,® and ultimately decide on an outcome via 
a transparent decision making process. There are many ways 
such a process could be structured—we encourage applicants to 
be innovative, building off known methodologies, and coming up 
with wholly new approaches. Examples of creative approaches that 
inspire us include Wikipedia, Twitter Community Notes, 


DemocracyNext, Platform Assemblies, MetaGov, RadicalxChange, 


People Powered, Collective Response Systems, and pol.is. 


Another notable ongoing effort is led by the Collective Intelligence 


Project (CIP), with whom we are partnering on public input to Al, 
contributing to their upcoming Alignment Assemblies. We also 


encourage applicants to envision how Al could enhance the 
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democratic process. For example, Al could enable more efficient 


communication among numerous people. 


A basic, illustrative prototype of a system that utilizes ChatGPT to 
promote deliberation and encourage consensus building, inspired 
by pol.is. 


Several issues can undermine democratic processes, such as the 
failure to adequately represent minority or majority groups, 
manipulation by special interest groups, insufficiently informed 


participants, or participation washing. We are looking for teams 
who proactively address these failure modes, and demonstrate 
awareness of the potential flaws and downsides of various 
approaches. Ultimately, designing truly democratic processes is a 
high bar to meet, and we view our efforts as complements rather 
than substitutes for regulation of Al by governments; this program 
encourages best-effort, democratic-in-spirit processes involving 
deliberation and broad public input as stepping stones. 


Instructions for participation 


To apply for a grant, we invite you to submit the required 
application material by 9:00 pm PDT June 24, 2023. You can 
access the application portal here. You will be prompted to answer 
a series of questions regarding your team’s background, your 
choice of questions, high level details of your proposed tool as well 
as your plan for conducting and evaluating the democratic process 
with these factors in mind. We would like you to design your 


approach to address one or more of the policy questions from the 
list provided. Anyone (individuals or organizations) can apply for 


this opportunity, regardless of their background in social science or 


3 of 7 9/24/23, 4:02 PM 


Democratic inputs to AI about:reader?url=https%3A%2F%2Fopenai.com%2Fbl... 


Al. 


Once the application period closes, we hope to select ten 
successful grant recipients. Recipients may be individuals, teams, 
or organizations. Each recipient will receive a $100,000 grant to 
pilot their proposal as described in their application materials. 
Grant recipients are expected to implement a proof-of-concept / 
prototype, engaging at least 500 participants and will be required 
to publish a public report on their findings by October 20, 2023. 
Additionally, as part of the grant program, any code or other 
intellectual property developed for the project will be required to be 
made publicly available pursuant to an open-source license. The 
terms applicable to grant recipients are specified in the Grant 
Terms and any other agreements that grant recipients may be 
asked to enter into with us in connection with this program. 


Timeline 


June 24, 2023 9:00 pm Pacific Time: Deadline to submit grant 
application 


July 14, 2023: Successful applicants will be selected and notified 


October 20, 2023: Complete public report of working prototype and 
results 


Policy statements under consideration 


To participate, teams should choose one or more questions from 
the provided list to showcase their proposed approach. They may 
also create their own questions if desired. Importantly, we 
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encourage teams to consider questions for which a simple “yes” or 
“no” answer would be inadequate, necessitating a nuanced policy 
proposal instead. 


The scope of this grant pertains to policy questions concerning 
model behavior, as it enables A/B tests with modified model 
behavior according to the policy recommendations. We 
acknowledge the limitations of this grant and recognize that 
numerous Al issues could be addressed through the democratic 
process, extending beyond model behavior to include areas such 
as guidelines for the use of Al in various contexts, economic 
impact, distribution of benefits and more. 


e How far do you think personalization of Al assistants like ChatGPT 
to align with a user’s tastes and preferences should go? What 
boundaries, if any, should exist in this process? 


e How should Al assistants respond to questions about public figure 
viewpoints? e.g., Should they be neutral? Should they refuse to 
answer? Should they provide sources of some kind? 


e Under what conditions, if any, should Al assistants be allowed to 
provide medical/financial/legal advice? 


e In which cases, if any, should Al assistants offer emotional support 
to individuals? 


e Should joint vision—language models be permitted to identify 
people’s gender, race, emotion, and identity/name from their 
images? Why or why not? 


e When generative models create images for underspecified prompts 
like “a CEO,” “a doctor,” or “a nurse,” they have the potential to 
produce either diverse or homogeneous outputs. How should Al 
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models balance these possibilities? What factors should be 
prioritized when deciding the depiction of people in such cases? 


What principles should guide Al when handling topics that involve 
both human rights and local cultural or legal differences, like 
LGBTQ rights and women’s rights? Should Al responses change 
based on the location or culture in which it’s used? 


Which categories of content, if any, do you believe creators of Al 
models should focus on limiting or denying? What criteria should 
be used to determine these restrictions? 


The primary objective of this grant is to foster innovation in 
processes—we need improved democratic methods to govern Al 
behavior. The specific answers to the questions matter less than 
the advancements made in the process itself. 


Application advisory committee 
Application review factors 


Evaluation: We encourage participants to establish metrics for 
evaluating the quality of their methods, such as participant 
satisfaction, shifts in polarization, scalability, or other relevant 
indicators, and to invent new metrics for a healthy democratic 
process. 


Robustness: Measures to prevent or address inappropriate 
behavior, such as trolling and fake accounts. 


Inclusiveness and representativeness: Strategies for including 
individuals from diverse backgrounds and levels of familiarity with 
Al systems in the democratic process. 
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e Empowerment of Minority Opinions: Ensuring that unpopular or 
minority opinions are heard and providing smaller groups the 
opportunity to influence matters of significant concern to them. 


e Effective Moderation: Addressing challenges in moderation, 
including ensuring diverse representation of viewpoints, 
distinguishing valuable contributions from “off-topic” comments, 
and preventing moderator biases from influencing the process. 


Scalability: We emphasize scalable processes that can be 
conducted virtually, rather than through in-person engagement. We 
are aware that this approach might sacrifice some benefits 
associated with in-person discussions, and we recognize that 
certain aspects could be lost in a virtual setting. 


Actionability: The degree of actionability of the information 
elicited by the deliberation process. 


e Legibility: How easy it is to understand and trust the process. 
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